System and method of gesture detection for a remote device

ABSTRACT

A method for operating a mobile device includes detecting a gesture by the mobile device. Detecting the gesture includes receiving a reflected millimeter wave signal by the mobile device, generating a first message in accordance with the detected gesture, and transmitting the first message from the mobile device to an external remote device. The detected gesture is associated with an operation of the remote device.

This application is a continuation of U.S. patent application Ser. No.15/401,598, filed on Jan. 9, 2017, which application is herebyincorporated herein by reference.

TECHNICAL FIELD

This disclosure relates in general to a system and method for gesturedetection, and, in particular embodiments, to a system and method ofgesture detection for a remote device.

BACKGROUND

The future Internet of Things (IoT) will feature the internetworking ofphysical devices, vehicles, buildings and other “things” embedded withelectronics, software, sensors, actuators, and/or network connectivitythat enable these objects to collect and exchange data. The IoT willallow objects to be sensed and/or controlled remotely across existingnetwork infrastructure, creating opportunities for more directintegration of the physical world into computer-based systems, andresulting in improved efficiency, accuracy and economic benefit.

Each connected thing in the future IoT may be uniquely identifiablethrough its embedded computing system but still able to interoperatewithin the existing Internet infrastructure. Experts estimate that theIoT will consist of almost 50 billion objects by 2020.

This burgeoning IoT will feature an ever-widening focus onmachine-to-machine (M2M) communication. In such a world where physicalobjects are more networked than ever and will be having their ownconversations around us, questions remain about what the future willhold for human-to-machine (H2M) communication. Human participants mayfeel increasingly disembodied as they stare at diminutive displays,manipulate their fingers across glass surfaces with unnatural swiping,spreading, and pinching motions, and read automated social mediamessages created by software applications.

SUMMARY

In accordance with a first example embodiment of the present invention,a method for operating a mobile device is provided. The method includesdetecting a gesture by the mobile device. Detecting the gesture includesreceiving a reflected millimeter wave signal by the mobile device,generating a first message in accordance with the detected gesture, andtransmitting the first message from the mobile device to an externalremote device. The detected gesture is associated with an operation ofthe remote device.

In accordance with a second example embodiment of the present invention,a method for operating a first device is provided. The method includesreceiving, by the first device from an external mobile device, a firstmessage generated using millimeter wave radar signaling in a field ofview of the mobile device. The method also includes processing, by thefirst device, the first message to detect a gesture associated with anoperation of the first device, and performing, by the first device, anoperation in accordance with the detected gesture.

In accordance with a third example embodiment of the present invention,a control circuit for a first device is provided. The circuit includes areceiver configured to receive, from an external mobile device, a firstmessage including radar data generated using millimeter wave radarsignaling in a field of view of the mobile device. The circuit alsoincludes a processor and a non-transitory computer readable mediumstoring programming for execution by the processor. The programmingincludes instructions to process the first message to detect a gestureassociated with an operation of the first device, and to perform theoperation of the first device in accordance with the detected gesture.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the disclosure, reference is nowmade to the following descriptions taken in conjunction with theaccompanying drawings, in which:

FIG. 1 is a block diagram illustrating a gesture detection system inaccordance with one of a number of embodiments;

FIG. 2 is a table illustrating a mapping between gestures and remotedevice functions in accordance with one of a number of embodiments;

FIG. 3A is a block diagram illustrating charging a mobile device by aremote device in accordance with one of a number of embodiments;

FIG. 3B is a block diagram illustrating wirelessly charging a mobiledevice by a remote device in accordance with one of a number ofembodiments;

FIG. 3C is a block diagram illustrating an automobile used as the remotedevice of FIG. 3B;

FIG. 4 is a block diagram illustrating a radar system that may be usedin the gesture detection system of FIG. 1 in accordance with one of anumber of embodiments;

FIG. 5A is a flow diagram illustrating a first method for operating amobile device in a gesture detection system in accordance with one of anumber of embodiments;

FIG. 5B is a flow diagram illustrating an alternative method foroperating a mobile device in a gesture detection system in accordancewith one of a number of embodiments;

FIG. 6 is a flow diagram illustrating a first implementation of themethod of FIG. 5B in greater detail, in accordance with one of a numberof embodiments;

FIG. 7 is a flow diagram illustrating an alternative implementation ofthe method of FIG. 5B in greater detail, in accordance with one of anumber of embodiments;

FIG. 8A is a flow diagram illustrating a first method for operating aremote device in a gesture detection system in accordance with one of anumber of embodiments;

FIG. 8B is a flow diagram illustrating an alternative method foroperating a remote device in a gesture detection system in accordancewith one of a number of embodiments;

FIG. 9 is a block diagram illustrating a processing system forperforming methods described, which may be installed in a host device inaccordance with one of a number of embodiments; and

FIG. 10 illustrates a block diagram of a transceiver adapted to transmitand receive signaling over a telecommunications network in accordancewith one of a number of embodiments.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

The making and using of various embodiments are discussed in detailbelow. It should be appreciated, however, that the disclosure providesmany applicable concepts that can be embodied in a wide variety ofspecific contexts. The specific embodiments discussed are merelyillustrative of specific ways to make and use embodiments, and do notlimit the scope of the invention.

In various embodiments, a radar-based gesture detection system is usedto control a remote device such, as, e.g., a vehicle, a building, a homeappliance, etc. For example, when the remote device is a car, anembodiment gesture detection system allows a human participant tocontrol various operations of the car from outside the car whileapproaching it.

In various embodiments, the gesture detection system includes a gesturesensor built into a mobile device such as, for example, a car key, awristwatch, a smart phone, etc. In such embodiments, the mobile devicemay relay either raw radar data or processed control messages to theremote device so that the remote device will perform a desiredoperation. For example, a thumbs-up hand gesture may be detected by asmart key and relayed to a car, causing the trunk to open. Such a smartkey gesture sensor could have a much smaller radar detection range thana hypothetical gesture sensor located in the car, and this smallerdetection range would help prevent interfering radar reflections,including interfering gestures, from affecting the proper behavior ofthe system. As an example, the radar detection range may be reduced to30 cm or less so that the mobile device may interact only with theintended operator, who could be, e.g., a person wearing the mobiledevice, holding the mobile device, carrying it in a pants pocket, etc.

In various embodiments, the mobile device could be paired with theremote device via a shared security key, so that data is encrypted fortransmission from the mobile device and decrypted at the remote device,and vice versa. The data transfer between the mobile device and remotedevice could include any of a wide variety of communicationstechnologies, including, e.g., Bluetooth, V2X, etc.

In various embodiments, the gesture detection system may be programmedvia a user interface at the remote device, so that an end user is ableto assign a remote device operation to each gesture. For example, analphabet of 6 gestures may be loaded by default in the system, and theend user may be able to select which function to associate to eachgesture. Emergency contact information could also be entered and anemergency call function associated with a gesture.

In various embodiments, the gesture recognition may cause sounds to beemitted by the mobile device based on feedback from the remote device.The feedback may indicate, for example, that a hand-shake with theremote device was successful or that a gesture-indicated operation wassuccessfully performed by the remote device. For example, the volume ofa sound generated by a smart key may increase as the temperature settingof a car's air conditioning system increases in response to usergestures detected by the smart key.

In an embodiment, the mobile device's radar data may include radartiming and/or frequency information. In an embodiment, the mobile devicemay process its radar data to detect a gesture. In another embodiment,however, the mobile device may transfer raw radar data over, forexample, a large bandwidth connection (e.g., WiFi, WiGig, etc.) so thata processor embedded in the remote device may process the radar data andclassify it as a particular gesture.

In various embodiments where the remote device is an automobile, themobile device could be a smart key such as, e.g., an ignition or vehicleaccess key that includes a radar-based gesture sensor. The main drawbackof such an implementation would be that such a smart key may have abattery with a short battery life. To combat this short battery life, insome embodiments a wireless charging system or other charging system maybe built into the cockpit of the vehicle remote device.

FIG. 1 shows an embodiment gesture detection system 100. The gesturedetection system 100 includes a mobile device 106 and a remote device104. The mobile device 106 may be, for example, a car key, a wristwatch,a smart phone, etc. In an embodiment, the remote device is a vehicle,and the mobile device is a vehicle access key and/or a vehicle ignitionkey.

Referring again to FIG. 1, the mobile device 106 includes a transceiver110 and antenna 111 that communicate with a transceiver 112 and antenna113 of the remote device 104. In some embodiments, each of the antenna111 and the antenna 113 may include multiple arrays of receive andtransmit antennas.

Referring again to FIG. 1, the mobile device 106 includes a gesturesensor 101. The gesture sensor 101 includes a radar transmit antenna 116and a radar receive antenna 118. In an embodiment, the radar transmitantenna 116 and the radar receive antenna 118 are tuned formillimeter-wave frequencies. In some embodiments, each of the radartransmit antenna 116 and the radar receive antenna 118 may includemultiple antenna arrays. In other embodiments, any of antennas 111, 116,and 118 may be combined into a single antenna or antenna array.

Referring again to FIG. 1, the gesture sensor 101 has a field of view102 that features a maximum detection range 114. A gesture such as,e.g., a hand gesture 108 that is made within the field of view 102 isdetectable by the gesture sensor 101.

FIG. 2 shows an embodiment mapping 202 between exemplary hand gesturesand associated operations that may be performed in an automobile used asthe remote device 102. In the embodiment of FIG. 2, a first hand gesturein which the fingers and thumb are pointed forward may be used to setthe air conditioning of the car, including, e.g., reducing thetemperature. A second gesture in which the hand is held flat may be usedto switch on seat heating. A third “thumbs up” gesture may be used toopen the car trunk. A fourth hand gesture is a balled fist that may beused to close the car trunk. A fifth hand gesture is an “OK” sign thatmay be used to switch on the automobile dome light. A sixth hand gesturepinches the thumb to fingers extended forward to start an emergencycall. In other embodiments, these and other gestures may be associatedwith a variety of operations of a remote device, including, for example,turning on the remote device, turning off the remote device, turning asound system on or off, tuning a radio channel, changing content of auser display, turning an auto-pilot program on or off, turning a voicerecognition program on or off, mapping a route, looking up weather, roadcondition, and/or traffic information, initiating a diagnostic test,enabling or disabling a security system of the remote device, generatinga sound and/or a haptic output, etc.

FIG. 3A shows an embodiment remote device 304 that may be used as theremote device 104 of FIG. 1. Remote device 304 includes a charger 303that may be used to charge a battery of mobile device 106. The charger303 may be implemented as, for example, the wireless charger 303A, shownin FIG. 3B. FIG. 3C is a block diagram illustrating an automobile usedas the remote device of FIG. 3B.

FIG. 4 illustrates an embodiment radar system 450 that may be used inone of a number of embodiments of the gesture sensor 101 of FIG. 1. Asshown, radar transceiver device 452 is configured to transmit anincident RF signal toward object 482 via transmit antenna 470 a and/ortransmit antenna 470 b, and receive a reflected RF signal via an antennaarray that includes receive antennas 472 a-d. Radar transceiver device452 includes receiver front end 462 coupled to receive antennas 472 a-d,first transmitter front end 454 coupled to transmit antenna 470 a andsecond transmitter front end 460 coupled to transmit antenna 470 b.Radar circuitry 456 provides signals to be transmitted to first andsecond transmitter front ends 454 and 460 and receives and/or processessignals received by receiver front end 462.

In an embodiment, the input to second transmitter front end 460 isselectable between an output of radar circuitry 456 and an output ofcommunication circuitry 458 via a circuit represented by switch 459.When second transmitter front end 460 receives input from radarcircuitry 456, both first transmitter front end 454 and secondtransmitter front end 460 can be used to build a holographic radar. Onthe other hand, when second transmitter front end 460 receives it inputfrom communication circuitry 458, first transmitter front end 454provides a radar signal to transmit antenna 470 a and second transmitterfront end 460 provides a communications signal to transmit antenna 470b. This communications signal may be a carrier modulated signal. In oneexample, the second transmitter front end 460 may transmit a bipolarphase-shift keyed (BPSK) modulated signal to satellite radar device 480that contains data. In some embodiments, a data link between radartransceiver device 452 and satellite radar device 480 may be used tocoordinate RF transmission and reception between radar transceiverdevice 452 and satellite radar device 480 to implement phase array beamsteering. In some embodiments, satellite radar device 480 may also becapable of data transmission and radar transceiver device 452 may beconfigured to receive data from satellite radar device 480 via antennas472 a-d.

In an embodiment, radar transceiver device 452, or portions of radartransceiver device 452 may be implemented in a package that containsfirst transmitter front end 454, second transmitter front end 460,receiver front end 462, as well as transmit antennas 470 a and 470 b andreceive antennas 472 a-d. In an embodiment, a ball grid array (BGA)package that contains patch antennas may be used to implement antennas470 a, 470 b and 472 a-d. In alternative embodiments, other antennaelements may be used besides patch antennas, for example, a Yagi-Udaantenna may be used provide sensing from the side of the packaged chipand antenna module.

In an embodiment, the frequency of operation of radar system 450, aswell as other embodiments, disclosed in this disclosure, is betweenabout 57 GHz and about 66 GHz. Alternatively, embodiment systems mayoperate at frequencies outside of this range also. For example, in anembodiment the frequency of operation of radar system 450, as well asother embodiments disclosed in this disclosure, is between about 57 GHzand about 71 GHz.

A millimeter-wave radar-based gesture sensor has been described in U.S.application Ser. No. 14/954,198, filed on Nov. 30, 2015, whichapplication is incorporated herein by reference in its entirety.

FIG. 5A shows an embodiment method 500A for operating a radar-basedgesture sensing mobile device such as mobile device 106. The method 500Abegins at step 501, where a gesture (e.g., a hand gesture) is detectedby the mobile device. In an embodiment, the mobile device detects thisgesture by receiving a reflected millimeter wave signal using, forexample, an antenna or an array of antennas. At step 503, the mobiledevice generates a message in accordance with the detected gesture. Atstep 505, where the mobile device transmits the message to a remotedevice using, for example, a second antenna, a second array of antennas,the first antenna, etc. A particular operation of the remote device isassociated with the gesture detected in step 503, and then flow returnsto step 501. In an embodiment where the remote device is a vehicle, theoperation associated with the detected gesture may include, for example,setting an air conditioning setting of the vehicle, setting heatseating, opening a trunk of the vehicle, setting a lighting setting,initiating an emergency call, etc.

FIG. 5B shows an embodiment method 500A, which is the same as theembodiment method 500B except that it includes additional steps 507 and509. At step 507, the mobile device receives feedback from the remotedevice and generates a sound based on this feedback. The feedback mayinclude, for example, information about whether the remote devicesuccessfully performed the operation associated with the detectedgesture of step 503. At step 509, the mobile device is brought near tothe remote device and wirelessly charges its battery from a power sourcethat is a component of the remote device.

FIG. 6 shows an embodiment method that may be used to implement themethod 500B of FIG. 5B. Method 600 begins with block 501A, which is animplementation of the mobile device's gesture detection step 501. Block50A includes steps 602, 603, and 605. At step 602, the mobile devicetransmits a first millimeter wave signal to a location of the gesture.At step 603, the mobile device receives a reflected millimeter waveradar signal. This reflected millimeter wave signal has been reflectedfrom the location of the gesture. In an embodiment, the gesture islocated in a radar detection range of the mobile device that is notgreater than 30 centimeters.

Flow continues at step 605, where the mobile device detects whichgesture, movement, hand sign, etc. (referred to in this disclosure as a“gesture”) has created the radar signal by analyzing the manner in whichthe frequency content of the radar signal changes over time. In someembodiments, the radar signal is converted in to the frequency domainusing transform methods known in the art. These transform methodsinclude, but are not limited to a discrete Fourier transform (DFT), afast Fourier transform, a short-time Fourier Transform (STFT), andspectrogram analysis. During step 605, multiple transforms may becalculated over a sliding time window and peak frequencies of thesemultiple transforms may be tracked to analyze how the range Doppler andthe velocity of the target change over time. For example, one or morepeak frequency vs. time signals may be generated to track how thefrequency content of the radar signal changes over time. In variousembodiments, each gesture has a specific, pre-determined signature withrespect to how the frequency content of the radar signal changes overtime. Each gesture has previously been categorized by its associatedradar signature and these pre-determined signatures have been stored ina look up table (LUT) in the mobile device. During operation the mobiledevice verifies if the signal detected by the sensor corresponds to oneof the signatures stored in the LUT. By comparing the tracked frequencycontent of the radar signal with the stored signatures, a receivedgesture may be determined. Micro-Doppler analysis methods may also beused to analyze the radar signal and classify the gesture in someembodiments.

At step 607, the mobile device generates a first message indicatingwhich gesture has been detected. At step 609, the mobile devicetransmits this first message to a remote device, such as, e.g., remotedevice 104 of FIG. 1. In an embodiment, the transmitted message isencrypted by the mobile device using a shared security key that isshared between the mobile device and the remote device.

Referring again to FIG. 6, at step 611, the mobile device receivesfeedback from the remote device and generates a sound based on thisfeedback. At step 613, the mobile device is brought near to the remotedevice and wirelessly charges its battery from a power source that is acomponent of the remote device.

FIG. 7 shows an alternative embodiment method 700 for operating a mobiledevice in conjunction with a remote device. Method 700 begins with block501B, which is an alternative implementation of the mobile device'sgesture detection step 501 of FIG. 5. Block 501B includes steps 702 and703. At step 702, the mobile device transmits a millimeter wave signalto a location of a gesture. At step 703, the mobile device receives areflected millimeter wave radar signal from the gesture location. Atstep 709, the mobile device generates a message containing radar timinginformation and/or radar frequency information and transmits thismessage to the remote device. At step 711, the remote device analyzeshow frequency content of the radar data changes over time to detect agesture. Each gesture has previously been categorized by its associatedradar signature and these pre-determined signatures have been stored inassociation with an associated remote device operation in an LUT in theremote device. During operation the remote device verifies if the signaldetected by the sensor corresponds to one of the signatures stored inthe remote device. At step 713, the mobile device receives feedback fromthe remote device and generates a sound based on this feedback. At step715, the mobile device is brought near to the remote device andwirelessly charges its battery from a power source that is a componentof the remote device.

FIG. 8A shows an embodiment method 800A for operating a remote devicesuch as, e.g., remote device 104 of FIG. 1. Method 800A begins with step802, where the remote device receives a message from a mobile device.The message has been generated by the remote device using millimeterwave radar signaling in a field of view of the mobile device. In anembodiment, the remote device is a vehicle and the mobile device is avehicle access key and/or a vehicle ignition key. At step 805, theremote device processes the received message to detect a gestureassociated with an operation of the remote device. In an embodiment, thereceived message includes radar data, which the remote device processesby analyzing frequency content of the radar data to detect the gesture.Each gesture has previously been categorized by its associated radarsignature and these pre-determined signatures have been stored inassociation with an associated remote device operation in an LUT in theremote device. During operation the remote device verifies if the signaldetected by the sensor corresponds to one of the signatures stored inthe remote device. At step 807, the remote device performs theassociated operation based on the detected gesture. Flow then returns tostep 801.

FIG. 8B shows an embodiment method 800B that is the same as method 80Aexcept that it begins with an additional step 801 and ends withadditional steps 809 and 811. At step 801, the remote device receivesuser input to program the remote device. As a first example, the userinput includes emergency contact information, so that the remote devicemay later initiate a call based on this emergency contact information.As a second example, the user input includes a desired associationbetween one or more operations of the remote device and correspondinggesture(s), and the remote device creates this desired association.

At step 809, the remote device generates feedback on whether the remotedevice successfully performed the operation associated with the detectedgesture, and then transmits this feedback to the mobile device. Theassociated operation may include, as a first example, adjusting asetting within a range of values. For example, the operation may beadjusting a temperature setting, and a corresponding feedback mayinclude a variable feedback signal that varies based on the adjustmentof the temperature setting. As a second example the associated operationmay be to initiate an emergency call based on emergency contactinformation received from the user at step 801.

Referring again to FIG. 8B, flow continues at step 811, where the remotedevice wirelessly charges the mobile device's battery from a powersource that is a component of the remote device. Flow then returns tostep 802.

FIG. 9 illustrates a block diagram of an embodiment processing system2000 for performing methods described in this disclosure, which may beinstalled in a host device such as, e.g., the mobile device 106 or theremote device 104 of FIG. 1. As shown, the processing system 2000includes a processor 2004, a memory 2006, and interfaces 2010-2014,which may (or may not) be arranged as shown in FIG. 9. The processor2004 may be any component or collection of components adapted to performcomputations and/or other processing related tasks, and the memory 2006may be any component or collection of components adapted to storeprogramming and/or instructions for execution by the processor 2004.

In an embodiment, the memory 2006 includes a non-transitory computerreadable medium storing programming for execution by the processor 204.In an embodiment, this programming includes instructions to process amessage received from an external mobile device. These instructions mayallow the processor 204 to detect a gesture associated with an operationof the host device and then cause the host device to perform theoperation based on this detected gesture. In an embodiment, thisreceived message includes radar data, and the instructions to processthe message include analyzing the frequency content of the radar data.In an embodiment, the memory 2006 includes an LUT 2008 storingpre-determined time domain radar signature(s) uniquely identifying oneor more gesture(s) and associating each gesture with a respectiveoperation of the remote device 106. In an embodiment, an operation ofthe host device that is associated with a gesture may include any of thefollowing: turning on the host device, turning off the host device,setting a temperature setting of the host device, setting a fan settingof the host device, turning on a sound system of the host device,turning off the sound system, setting a volume setting of the soundsystem, selecting an input of the sound system, tuning a radio channelof the host device, opening a mechanical latch of the host device,turning on a light of the host device, turning off the light, setting adimming setting of the light, changing a color of the light, turning ona user display of the host device, turning off the user display,changing visible content of the user display, setting a cruise controlsetting, auto-pilot program, or voice recognition program of the hostdevice, mapping a route, looking up weather/road/traffic information,initiating a diagnostic test of the host device, enabling or disabling asecurity system of the host device, initiating a communications session,etc.

In the embodiment of FIG. 9, the LUT 2008 is included within the memory2006, but in other embodiments the LUT 2008 may be implementedseparately from the memory 2006. One or both of the LUT 2008 or thememory 2006 may be implemented in a Field Programmable Gate Array(FPGA), an Application Specific Integrated Circuit (ASIC), or otherintegrated circuit.

Referring again to FIG. 9, the interfaces 2010, 2012, 2014 may be anycomponent or collection of components that allow the processing system2000 to communicate with other devices/components and/or a user. Forexample, one or more of the interfaces 2010, 2012, 2014 may be adaptedto communicate data, control, or management messages from the processor2004 to applications installed on the host device and/or an externaldevice. As another example, one or more of the interfaces 2010, 2012,2014 may be adapted to allow a user or user device (e.g., personalcomputer (PC), etc.) to interact/communicate with the processing system2000. The processing system 2000 may include additional components notdepicted in FIG. 9, such as long term storage (e.g., non-volatilememory, etc.).

In some embodiments, the processing system 2000 is included in a networkdevice that is accessing, or part otherwise of, a telecommunicationsnetwork. In one example, the processing system 2000 is in a network-sidedevice in a wireless or wireline telecommunications network, such as abase station, a relay station, a scheduler, a controller, a gateway, arouter, an applications server, or any other device in thetelecommunications network. In other embodiments, the processing system2000 is in a user-side device accessing a wireless or wirelinetelecommunications network, such as a mobile station, a user equipment(UE), a personal computer (PC), a tablet, a wearable communicationsdevice (e.g., a smartwatch, etc.), or any other device adapted to accessa telecommunications network.

In some embodiments, one or more of the interfaces 2010, 2012, 2014connects the processing system 2000 to a transceiver adapted to transmitand receive signaling over the telecommunications network. FIG. 10illustrates a block diagram of a transceiver 2100 adapted to transmitand receive signaling over a telecommunications network. The transceiver2100 may be installed in a host device. As shown, the transceiver 2100comprises a network-side interface 2102, a coupler 2104, a transmitter2106, a receiver 2108, a signal processor 2110, and a device-sideinterface 2112. The network-side interface 2102 may include anycomponent or collection of components adapted to transmit or receivesignaling over a wireless or wireline telecommunications network. Thecoupler 2104 may include any component or collection of componentsadapted to facilitate bi-directional communication over the network-sideinterface 2102. The transmitter 2106 may include any component orcollection of components (e.g., up-converter, power amplifier, etc.)adapted to convert a baseband signal into a modulated carrier signalsuitable for transmission over the network-side interface 2102. Thereceiver 2108 may include any component or collection of components(e.g., down-converter, low noise amplifier, etc.) adapted to convert acarrier signal received over the network-side interface 2102 into abaseband signal. In an embodiment, the receiver 2108 is configured toreceive, from an external mobile device, a message that includes radardata generated using millimeter wave radar signaling in a field of viewof the mobile device. The signal processor 2110 may include anycomponent or collection of components adapted to convert a basebandsignal into a data signal suitable for communication over thedevice-side interface(s) 2112, or vice-versa. The device-sideinterface(s) 2112 may include any component or collection of componentsadapted to communicate data-signals between the signal processor 2110and components within the host device (e.g., the processing system 2000,local area network (LAN) ports, etc.).

The transceiver 2100 may transmit and receive signaling over any type ofcommunications medium. In some embodiments, the transceiver 2100transmits and receives signaling over a wireless medium. For example,the transceiver 2100 may be a wireless transceiver adapted tocommunicate in accordance with a wireless telecommunications protocol,such as a cellular protocol (e.g., long-term evolution (LTE), etc.), awireless local area network (WLAN) protocol (e.g., Wi-Fi, etc.), or anyother type of wireless protocol (e.g., Bluetooth, near fieldcommunication (NFC), etc.). In such embodiments, the network-sideinterface 2102 comprises one or more antenna/radiating elements. Forexample, the network-side interface 2102 may include a single antenna,multiple separate antennas, or a multi-antenna array configured formulti-layer communication, e.g., single input multiple output (SIMO),multiple input single output (MISO), multiple input multiple output(MIMO), etc. In other embodiments, the transceiver 2100 transmits andreceives signaling over a wireline medium, e.g., twisted-pair cable,coaxial cable, optical fiber, etc. Specific processing systems and/ortransceivers may utilize all of the components shown, or only a subsetof the components, and levels of integration may vary from device todevice.

Illustrative embodiments may use a remote device controlled by a mobiledevice that includes a radar-based gesture sensor having a small fieldof view relative to that of a gesture sensor located in the remotedevice. The merits of such embodiments may include preventinginterfering gestures and other radar reflections from interfering withthe correct detection of a target gesture.

The following additional example embodiments of the present inventionare also provided. In accordance with a first example embodiment of thepresent invention, a method for operating a mobile device is provided.The method includes detecting a gesture by the mobile device. Detectingthe gesture includes receiving a reflected millimeter wave signal by themobile device, generating a first message in accordance with thedetected gesture, and transmitting the first message from the mobiledevice to an external remote device. The detected gesture is associatedwith an operation of the remote device.

Also, the foregoing first example embodiment may be implemented toinclude one or more of the following additional features. The method mayalso be implemented such that detecting the gesture further includestransmitting, by the mobile device, a first millimeter wave signal to alocation of the gesture. The reflected millimeter wave signal includes areflection of the first millimeter wave signal reflected from thelocation of the gesture.

The method may also be implemented such that the gesture is located adistance of not greater than 30 centimeters from the mobile device. Themethod may also be implemented such that the mobile device includes atleast one of a mobile phone, a watch, or a key for the remote device.The method may also be implemented further including wirelessly charginga battery of the mobile device, by the mobile device, from a powersource of the remote device. The method may also be implemented suchthat the remote device includes a vehicle, and the mobile deviceincludes at least one of a vehicle access key or a vehicle ignition key.The method may also be implemented such that the operation includes atleast one of setting an air conditioning setting of the vehicle, settinga heat seating setting of the vehicle, opening a trunk of the vehicle,setting a lighting setting of the vehicle, or initiating an emergencycall. The method may also be implemented such that the gesture includesa hand gesture. The method may also be implemented such that detectingthe gesture further includes determining frequency content of thereflected millimeter wave signal, tracking the frequency content of thereflected millimeter wave signal over time, and comparing the trackedfrequency content to a pre-determined gesture signature stored in alook-up table. The method may also be implemented such that the mobiledevice further includes a first antenna and a second antenna. Receivingthe reflected millimeter wave signal includes receiving using the firstantenna and transmitting the first message includes transmitting usingthe second antenna. The method may also be implemented such that thefirst antenna includes a receive antenna array and a transmit antennaarray. The method may also be implemented such that transmitting thefirst message includes encrypting, by the mobile device, the firstmessage using a shared security key of the mobile device and the remotedevice. The method may also be implemented further including receivingfeedback, by the mobile device from the remote device, such that thefeedback includes a status of whether the remote device successfullyperformed the operation associated with the gesture. The method may alsobe implemented further including generating, by the mobile device, asound in accordance with the received feedback. The method may also beimplemented such that the operation includes adjusting a temperaturesetting, the received feedback includes a variable feedback signal thatvaries in accordance with the adjusted temperature setting, andgenerating the sound includes adjusting the sound in accordance with thevariable feedback signal. The method may also be implemented such thatthe first message includes at least one of radar timing information orradar frequency information.

In accordance with a second example embodiment of the present invention,a method for operating a first device is provided. The method includesreceiving, by the first device from an external mobile device, a firstmessage generated using millimeter wave radar signaling in a field ofview of the mobile device. The method also includes processing, by thefirst device, the first message to detect a gesture associated with anoperation of the first device, and performing, by the first device, anoperation in accordance with the detected gesture.

Also, the foregoing second example embodiment may be implemented toinclude one or more of the following additional features. The method mayalso be implemented further including decrypting the first message, bythe first device, in accordance with a shared security key of the mobiledevice and the first device. The method may also be implemented furtherincluding wirelessly charging the mobile device by a power source, suchthat the first device includes the power source. The method may also beimplemented such that the first device includes a vehicle and the mobiledevice includes at least one of a vehicle access key or a vehicleignition key.

The method may also be implemented such that the first message includesradar data. Processing the first message includes performing a spectralanalysis of the radar data, tracking frequency content of the radar dataover time based on the spectral analysis; and matching the trackedfrequency content with a pre-determined gesture signature stored in alook-up table.

The method may also be implemented further including generating feedbackincluding a status of whether the first device successfully performedthe operation associated with the gesture and transmitting the feedbackfrom the first device to the mobile device. The method may also beimplemented such that performing the operation includes adjusting atemperature setting and the feedback includes a variable feedback signalthat varies in accordance with the adjusted temperature setting. Themethod may also be implemented such that performing the operationincludes initiating an emergency call. The method may also beimplemented further including receiving, by the first device, a userinput including emergency contact information, such that initiating theemergency call is in accordance with the emergency contact information.The method may also be implemented further including receiving, by thefirst device, user input including a desired operation of the firstdevice to be associated with a desired gesture, and associating thedesired operation with the desired gesture.

In accordance with a third example embodiment of the present invention,a control circuit for a first device is provided. The circuit includes areceiver configured to receive, from an external mobile device, a firstmessage including radar data generated using millimeter wave radarsignaling in a field of view of the mobile device. The circuit alsoincludes a processor and a non-transitory computer readable mediumstoring programming for execution by the processor. The programmingincludes instructions to process the first message to detect a gestureassociated with an operation of the first device, and to perform theoperation of the first device in accordance with the detected gesture.

Also, the foregoing third example embodiment may be implemented toinclude one or more of the following additional features. The circuitmay also be implemented further including a look-up table (LUT), suchthat the first message includes radar data. The instructions to processthe first message include instructions to perform a spectral analysis ofthe radar data, track frequency content of the radar data over timebased on the spectral analysis, and match the tracked frequency contentwith a pre-determined gesture signature stored in the LUT. The circuitmay also be implemented such that the operation includes at least one ofturning on the first device, turning off the first device, setting atemperature setting, setting a fan setting, turning on a sound system,turning off the sound system setting a volume setting of the soundsystem, selecting an input of the sound system, tuning a radio channel,opening a mechanical latch, turning on a light, turning off the light,setting a dimming setting of the light, changing a color of the light,turning on a user display, turning off the user display, changingvisible content of the user display, setting a cruise control setting,turning on an auto-pilot program, turning off the auto-pilot program,turning on a voice recognition program, turning off the voicerecognition program, mapping a route, looking up weather information,looking up information about a road condition, looking up informationabout traffic, initiating a diagnostic test, enabling a security system,disabling the security system, generating a sound, generating a hapticoutput, and initiating a communications session.

While this invention has been described with reference to illustrativeembodiments, this description is not intended to be construed in alimiting sense. Various modifications and combinations of theillustrative embodiments, as well as other embodiments of the invention,will be apparent to persons skilled in the art upon reference to thedescription. It is therefore intended that the appended claims encompassany such modifications or embodiments.

What is claimed is:
 1. A method for operating a wireless access key, themethod comprising: detecting a gesture by the wireless access key,wherein the wireless access key is configured to unlock an externalremote device and detecting the gesture comprises transmitting, by afirst transmitter of the wireless access key, a first millimeter wavesignal to a location of the gesture, and receiving a reflectedmillimeter wave signal by the wireless access key, wherein the reflectedmillimeter wave signal comprises a reflection of the first millimeterwave signal reflected from the location of the gesture; generating afirst message in accordance with the detected gesture, wherein the firstmessage comprises radar data based on the received reflected millimeterwave signal, wherein the first message comprises at least one of radartiming information or radar frequency information; and wirelesslytransmitting the first message from the wireless access key to theexternal remote device using a second transmitter different from thefirst transmitter, wherein the detected gesture is associated with anoperation of the external remote device.
 2. The method of claim 1,wherein: the gesture is located a distance of not greater than 30centimeters from the wireless access key.
 3. The method of claim 1,further comprising: wirelessly charging a battery of the wireless accesskey, by the wireless access key, from a power source of the externalremote device.
 4. The method of claim 1, wherein: the gesture comprisesa hand gesture.
 5. The method of claim 1, wherein detecting the gesturefurther comprises: determining frequency content of the reflectedmillimeter wave signal; tracking the frequency content of the reflectedmillimeter wave signal over time; and comparing the tracked frequencycontent to a pre-determined gesture signature stored in a look-up table.6. The method of claim 1, wherein: the wireless access key furthercomprises a first antenna and a second antenna; receiving the reflectedmillimeter wave signal comprises receiving using the first antenna; andtransmitting the first message comprises transmitting using the secondantenna.
 7. The method of claim 6, wherein: the first antenna comprisesa receive antenna array and a transmit antenna array.
 8. The method ofclaim 1, wherein: transmitting the first message comprises encrypting,by the wireless access key, the first message using a shared securitykey of the wireless access key and the external remote device.
 9. Themethod of claim 1, further comprising: receiving feedback, by thewireless access key from the external remote device, wherein thefeedback comprises a status of whether the external remote devicesuccessfully performed the operation associated with the gesture. 10.The method of claim 9, further comprising: generating, by the wirelessaccess key, a sound in accordance with the received feedback.
 11. Amethod for operating an external remote device, the method comprising:wirelessly receiving, by the external remote device from a wirelessaccess key, a first message using a first wireless protocol, wherein thefirst message comprises radar data generated using a millimeter waveradar system of the wireless access key, wherein the first wirelessprotocol operates using signals different from radar signals of themillimeter wave radar system of the wireless access key; processing, bythe external remote device, the first message to detect a gestureassociated with an operation of the external remote device; andperforming, by the external remote device, the operation in accordancewith the detected gesture.
 12. The method of claim 11, furthercomprising: decrypting the first message, by the external remote device,in accordance with a shared security key of the wireless access key andthe external remote device.
 13. The method of claim 11, furthercomprising: wirelessly charging the wireless access key by a powersource disposed within the external remote device.
 14. The method ofclaim 11, wherein: processing the first message comprises: performing aspectral analysis of the radar data; tracking frequency content of theradar data over time based on the spectral analysis; and matching thetracked frequency content with a pre-determined gesture signature storedin a look-up table.
 15. The method of claim 11, further comprising:generating feedback comprising a status of whether the external remotedevice successfully performed the operation associated with the gesture;and transmitting the feedback from the external remote device to thewireless access key.
 16. The method of claim 11, further comprising:receiving, by the external remote device, user input comprising adesired operation of the external remote device to be associated with adesired gesture; and associating the desired operation with the desiredgesture.
 17. A control circuit for an external remote device, thecontrol circuit comprising: a wireless receiver configured to receive,from a wireless access key, a first message using a first wirelessprotocol, wherein the first message comprises radar data generated usinga millimeter wave radar system of the wireless access key, wherein thefirst wireless protocol operates using signals different from radarsignals of the millimeter wave radar system of the wireless access key;a processor coupled to the wireless receiver; a non-transitory computerreadable medium storing programming for execution by the processor, theprogramming comprising instructions to: process the first message todetect a gesture associated with an operation of the external remotedevice; and perform the operation of the external remote device inaccordance with the detected gesture.
 18. The control circuit of claim17, further comprising a look-up table (LUT), wherein: the instructionsto process the first message comprise instructions to: perform aspectral analysis of the radar data; track frequency content of theradar data over time based on the spectral analysis; and match thetracked frequency content with a pre-determined gesture signature storedin the LUT.
 19. The control circuit of claim 17, wherein the operationcomprises at least one of: turning on the external remote device turningoff the external remote device, turning on a user display, turning offthe user display, changing visible content of the user display, turningon a voice recognition program, turning off the voice recognitionprogram, initiating a diagnostic test, enabling a security system,disabling the security system, generating a sound, generating a hapticoutput, and initiating a communications session.
 20. A method foroperating a wireless access key, the method comprising: detecting agesture by the wireless access key, wherein the wireless access key isconfigured to unlock an external remote device and detecting the gesturecomprises transmitting, by a first transmitter of the wireless accesskey, a first millimeter wave signal to a location of the gesture, andreceiving a reflected millimeter wave signal by the wireless access key,wherein the reflected millimeter wave signal comprises a reflection ofthe first millimeter wave signal reflected from the location of thegesture; generating a first message in accordance with the detectedgesture, wherein the first message comprises radar data based on thereceived reflected millimeter wave signal; wirelessly transmitting thefirst message from the wireless access key to the external remote deviceusing a second transmitter different from the first transmitter; andwirelessly charging a battery of the wireless access key, by thewireless access key, from a power source of the external remote device,wherein the detected gesture is associated with an operation of theexternal remote device.